Digital Image and Content Display Systems and Methods

ABSTRACT

Disclosed herein are systems and methods for displaying images and contextually relevant content on a digital content platform, such as a web page. In one embodiment, for example, the systems and methods include: (1) providing a publisher of the image with a reference script for publication with the image, wherein the reference script is a computer-readable instruction that causes an end-user device to call to a content server; and (2) configuring the content server to (a) receive a request for content from the end-user device, (b) identify content that is contextually relevant to the image, (c) deliver the content to the end-user device, and (d) deliver a computer-readable instruction that causes the end-user device to perform an animation that modifies the image and displays the content in a spatial relationship with respect to the image as originally published.

CROSS-REFERENCE TO RELATED APPLICATIONS

This application is a continuation of U.S. patent application Ser. No.13/564,609, filed on Aug. 1, 2012, which is a continuation of U.S.patent application Ser. No. 13/427,341, filed on Mar. 22, 2012, each ofwhich are incorporated herein by reference in its entirety.

SUMMARY

Disclosed herein are systems and methods for displaying images andcontextually relevant content on a digital content platform, such as aweb page. In one embodiment, for example, the systems and methodsinclude: (1) providing a publisher of the image with a reference scriptfor publication with the image, wherein the reference script is acomputer-readable instruction that causes an end-user device to call toa content server; and (2) configuring the content server to (a) receivea request for content from the end-user device, (b) identify contentthat is contextually relevant to the image, (c) deliver the content tothe end-user device, and (d) deliver a computer-readable instructionthat causes the end-user device to perform an animation that modifiesthe image and displays the content in a spatial relationship withrespect to the image as originally published.

BRIEF DESCRIPTION OF THE FIGURES

The accompanying drawings, which are incorporated herein, form part ofthe specification. Together with this written description, the drawingsfurther serve to explain the principles of, and to enable a personskilled in the relevant art(s), to make and use the claimed systems andmethods.

FIG. 1 is a high-level diagram illustrating an embodiment of the presentinvention.

FIG. 2 is a high-level diagram illustrating another embodiment of thepresent invention.

FIG. 3 is a high-level diagram illustrating yet another embodiment ofthe present invention.

FIG. 4 is a flowchart describing one embodiment of the presentinvention.

FIG. 5 is a flowchart describing another embodiment of the presentinvention.

FIG. 6 is a schematic drawing of a computer system used to implement themethods presented.

FIG. 7A shows one perspective view of an implementation of the presentinvention.

FIG. 7B shows a perspective view of an implementation of the presentinvention.

FIG. 7C shows a perspective view of an implementation of the presentinvention.

FIG. 7D shows a perspective view of an implementation of the presentinvention.

DEFINITIONS

Prior to describing the present invention in detail, it is useful toprovide definitions for key terms and concepts used herein. Unlessdefined otherwise, all technical and scientific terms used herein havethe same meaning as commonly understood by one of ordinary skill in theart to which this invention belongs.

Contextual Information or Contextual Tag: data related to the contentsand/or context of digital content (e.g., an image, or content within theimage); for example, but not limited to, a description, identification,index, or name of an image, or object, or scene, or person, orabstraction within the digital content (e.g., image).

Contextually Relevant Advertisement: A targeted advertisement that isconsidered relevant to the contents and/or context of digital content ona digital content platform.

Contextually Relevant Content: Any content (e.g., text, data, images,video, controls, applications, interactive functions, informationalfunctions) selected, created, identified, tagged, and/or provided basedat least in part on the subject. For example, “content that iscontextually relevant to an image” or “contextually relevant content forthe image” includes, without limitation, any content that is selected,created, identified, tagged, and/or provided based at least in part onthe image.

Crowdsource Network: One or more individuals, whether human or computer,used for a crowdsourcing application.

Crowdsourcing: The process of delegating a task to one or moreindividuals, with or without compensation.

Digital Content: broadly interpreted to include, without exclusion, anycontent available on a digital content platform, such as images, videos,text, audio, and any combinations and equivalents thereof.

Digital Content Platform: broadly interpreted to include, withoutexclusion, any web page, website, browser-based web application,software application, mobile device application (e.g., phone or tabletapplication), TV widget, and equivalents thereof.

Image: a visual representation of an object, or scene, or person, orabstraction, in the form of a machine-readable and/or machine-storablework product (e.g., one or more computer files storing a digital image,a browser-readable or displayable image file, etc.). As used herein, theterm “image” is merely one example of “digital content.”

Proximate: is intended to broadly mean “relatively adjacent, close, ornear,” as would be understood by one of skill in the art. The term“proximate” should not be narrowly construed to require an absoluteposition or abutment. For example, “content displayed proximate to animage,” means “content displayed relatively near an image, but notnecessarily abutting or within the image.” (To clarify: “contentdisplayed proximate to an image,” also includes “content displayedabutting or within the image.”) In another example, “content displayedproximate to an image,” means “content displayed on the same screen pageor web page as the image.”

Publisher: Party that owns, provides, and/or controls a digital contentplatform; or third-party charged with providing, maintaining, and/orcontrolling ad space on a digital content platform.

Before the present invention is described in greater detail, it is to beunderstood that this invention is not limited to particular embodimentsdescribed, and as such may vary. It is also to be understood that theterminology used herein is for the purpose of describing particularembodiments only, and is not intended to be limiting. The scope of thepresent invention will be limited only by the appended claims.

Incorporated by Reference Related Applications

Except for any term definitions that conflict with the term definitionsprovided herein, the following related, co-owned, and co-pendingapplications are incorporated by reference in their entirety: U.S.patent application Ser. Nos. 12/902,066; 13/005,217; 13/005,226;13/045,426; 29/387,270; 29/387,271; 29/387,272; 29/387,273; 13/151,110;13/219,460; 13/252,053; 29/403,731; 29/403,732; 29/403,733; 29/403,734;29/403,826; 13/296,124; 13/299,280; 13/308,401; and 13/352,188.

Detailed Description

A growing trend in modern computing devices is to limit screen sizes inorder to make devices more compact and portable. For example, where thedesktop computer was once commonplace, more recently end-users areaccessing software programs and the Internet on small mobile devices,such as tablets and mobile phones. Further, even when a user accessesthe Internet on a relatively larger screen/monitor, limitations with thesize of web browsers, application interfaces, and pixel count createlimitations on the amount of content a publisher can effectively provideon a digital content platform. The problem is compounded when publisherstry to cram images, videos, text, and advertisements into a relativelysmall amount of space, without ruining the aesthetic look of thepublication. As such, a publisher desires to maximize their use of“space” when publishing content on a digital content platform.

Images are typically the most information-rich content a publisher canprovide. Images provide condensed, high-density information. Publishers,however, seldom have the mechanisms to make an image interactive, so asto provide additional/supplemental content if/when a reader isinterested in the image. For example, a travel blog publisher may postan image of a hike he conducted through Yosemite National Park, alongwith text describing his hike. A reader of the blog may see the imageand wonder: How do I get to Yosemite National Park? Where can I buy thebag the hiker is wearing? Where can I buy the shoes the hiker iswearing? How can I share this image with my friends? If the travel blogpublisher wishes to add advertisements on how to get to YosemiteNational Park, where to buy the hiking bag, where to buy the hikingshoes, a link to share the image with friends, etc., the blog couldquickly become overcrowded with information, functionality, etc.Additionally, the travel blog publisher most likely prefers toconcentrate his time on creating additional blog postings, instead oftrying to identify and create content for all possible end-userconsiderations relative to each image he publishes.

The present invention generally relates to computer-implemented systemsand methods for providing and displaying contextually relevant contentfor an image published on a digital content platform. The presentinvention thereby provides means for publishers to effectively maximizetheir use of space on a digital content platform. In conjunction withthe systems and methods presented, a publisher can provide an image on adigital content platform, and a service provider can providecontextually relevant content, relative to the image, if/when a reader(i.e., an end-user) interacts with or shows interest in the image. Inone embodiment, for example, the presented systems and methods include:(1) providing a publisher of the image with a reference script forpublication with the image, wherein the reference script is acomputer-readable instruction that causes an end-user device to call toa content server maintained by a service provider; and (2) configuringthe content server to (a) receive a request for content from theend-user device, (b) identify content that is contextually relevant tothe image, (c) deliver the content to the end-user device, and (d)deliver a computer-readable instruction that causes the end-user deviceto perform an animation that displays the content in a spatialrelationship with respect to the image as originally published.

As such, in the example provided above, the travel blog publisher wouldsimply publish the blog post with the image of his hike, along with thetext describing his hike. The travel blog publisher would also publishhis blog post with a reference script that causes a reader's end-userdevice to call to the service provider. The service provider's systemcan then analyze the image (via a content decision engine as discussedbelow) and identify contextually relevant content for the image. If andwhen the reader shows interest in the image, (by, for example,mousing-over the image, touching/clicking the image, etc.) the serviceprovider then provides the content in a spatial relationship withrespect to the image, without affecting any of the other content on theweb page. For example, the service provider can providecomputer-readable instructions that cause the end-user device to createan animation that flips the image and thereafter displays thecontextually relevant content on the apparent “backside” of the image.In another embodiment, the animation completely covers the originallypublished image with contextually relevant content. By flipping orcompletely covering the originally published image, the publisher maylimit the risk of any potential misunderstanding or misrepresentation ofan “endorsement” of the contextually relevant content by the persons orplaces within the image. The contextually relevant content may include,for example, advertisement links for objects within the image,information about the contents of the image, additional softwareapplications allowing the user to perform functions (such as, save,share, print, etc.) on the image.

The following detailed description of the figures refers to theaccompanying drawings that illustrate exemplary embodiments. Otherembodiments are possible. Modifications may be made to the embodimentsdescribed herein without departing from the spirit and scope of thepresent invention. Therefore, the following detailed description is notmeant to be limiting.

FIG. 1 is a high-level diagram illustrating an embodiment of the presentinvention. More specifically, FIG. 1 shows a system and method 100 ofidentifying, providing, and displaying digital content on a digitalcontent platform. As shown in FIG. 1, a user 105 employs an end-userdevice 106 (e.g., a computer, tablet, mobile phone, television, etc.) toaccess a publisher's 110 digital content platform 112, via the Internet107 (or other equivalent network). The digital content platform 112 maybe a web page, website, browser-based web application, softwareapplication, mobile device application (e.g., phone or tabletapplication), TV widget, and equivalents thereof. In practice, thepublisher 110 publishes digital content (e.g., one or more images 113and/or text 115) on the digital content platform 112.

A service provider 120 provides a software widget (e.g., web widget,executable computer code, computer-readable instructions, referencescript, HTML script, etc.) for inclusion in the digital content platform112. In one embodiment, the software widget analyzes the digital contentplatform in order to identify any and all of the images published on theplatform. For example, the software widget can provide the function of“scraping” the platform for images (e.g., by walking the DOM nodes on anHTML script of a web page). In one embodiment, the software widget canbe configured to identify published images that meet predefinedcharacteristics, attributes, and/or parameters. The software widget thenprovides (or otherwise identifies) the images to the service provider120 for further analysis. The analysis of the images typically occurswithin a content decision engine 122, which may run within or inconjunction with the service provider's dedicated content server 121.

Within the content decision engine 122, the one or more published imagesare analyzed to identify contextually relevant content associated withthe published image. For example, if the image 113 depicts aprofessional athlete, contextually relevant content may includeinformation about the athlete's career, recent activities, associatedproduct advertisements, etc. In another example, if the image 113depicts a vacation setting, the contextually relevant content mayinclude where the setting is located, advertisements on how to get tothe vacation site, and other relevant information. Such contextuallyrelevant content is then provided back to the digital content platform112, for publication in a spatial relationship with respect to the image113, as further discussed below.

To function as a means for identifying contextually relevant content forthe image 113, the content decision engine 122 may employ analysissystem components such as: algorithmic identification 123 or analysis ofthe image; image recognition protocols 124 and analysis of the image;proximate text recognition 125 in search of contextual information ofthe image based on text 115 published proximate to the image 113;submission of the image to a crowdsource network 126 to identify thecontext of the image and tag the image with relevant data; a thematictagging engine 127 to identify and tag the image with relevant data,based on a pre-defined theme; publisher provided information database128; and/or any combinations or equivalents thereof. Aspects of thesystem components of the content decision engine 122 are described inthe above identified related applications, which have been incorporatedby reference herein.

For example, within the algorithmic identification system component 123,an analysis may be performed to identify data, tags, or other attributesof the image. Such attributes may then be used to identify and selectcontextually relevant content that matches the same attributes. Forexample, an algorithm may be provided that identifies contextuallyrelevant content having the same subject tag and size of the publishedimage. Such contextually relevant content is then provided back to theend-user device for display in spatial relationship with the originallypublished image.

Image recognition system component 124 may employ one or more imagerecognition protocols in order to identify the subject matter of theimage. An output of the image recognition system component 124 may thenbe used to identify and select contextually relevant content to beprovided back to the end-user device. Image recognition algorithms andanalysis programs are publicly available; see, for example, Wang et al.,“Content-based image indexing and searching using Daubechies' wavelts,”Int J Digit Libr (1997) 1:311-328, which is herein incorporated byreference in its entirety.

Text recognition system component 125 may collect and analyze text thatis published proximate to the image. Such text may provide contextualclues as to the subject matter of the image. Such contextual clues maythen be used to identify and select contextually relevant content to beprovided back to the end-user device. Examples of text recognitionsystem components are described in U.S. patent application Ser. No.13/005,217, which has been incorporated herein by reference.

A crowdsource network 126, alone or in combination with the additionallymentioned system components, may also be provided to identify and selectcontextually relevant content. In one embodiment, for example, acrowdsource network is provided with an interface for receiving,viewing, and/or tagging images published on one or more digital contentplatforms. The crowdsource network can be used to identify the contextof the image and/or identify and select contextually relevant contentthat is associated with the image. The crowdsource network may beprovided with specific instructions on how to best match images withassociated content.

A thematic tagging engine 127, alone or in combination with theadditionally mentioned system components, may also be provided toidentify and select contextually relevant content. In one embodiment,for example, the thematic tagging engine works in conjunction with acrowdsource network to receive, view, and/or tag images published on oneor more digital content platforms based on specific themes. Themes mayinclude marketable considerations provided by one or more third-partymerchants wishing to use the published images as an advertisingmechanism. Examples of thematic tagging systems are described in moredetail in U.S. patent application Ser. No. 13/299,280, which has beenincorporated herein by reference.

The content decision engine 122 may also be directly linked to thepublisher 110 to collect publisher provided information 128 with respectto the published image. For example, the publisher 110 may providecriteria for selecting which images are subject to analysis. Thepublisher 110 may also be provided with a “dashboard” or interface toconfigure various settings for the service provider's analysis. Forexample, the publisher can select what categories of contextuallyrelevant content (e.g., in the form of informational categories,interactive functions, etc.) to be provided with respect to thepublished images. In one example, the publisher 110 may selectinteractive applications as described in U.S. patent application Ser.No. 12/308,401, which has been incorporated herein by reference. Thepublisher 110 may also select what third-party merchants may be used toprovide advertisements for any particular image (or subset of images).

In operation, the service provider's software widget monitors the user's105 interactions with the image 113. If the user 105 activates the image(by, for example, clicking on a hotspot 114, mousing-over the image,viewing the image for a defined period of time, etc.), the softwarewidget sends a call to the service provider 120 (e.g., the serviceprovider's content server 121 and/or content decision engine 122) torequest contextually relevant content for the image. The software widget(or an associated “child” widgets) receives the contextually relevantcontent from the service provider 120, performs an animation on theimage 113, and then displays the contextually relevant content in aspatial relationship with respect to the originally published image. Forexample, in one embodiment, the software widget employs Cascading StyleSheets (CSS) language to perform a “flip” animation on the image 113, soas to show the contextually relevant content on the apparent backside ofthe image. (In alternative embodiments, other computer language may beused to perform the animate; such as, JavaScript and HTML 5 Canvas.)Preferably, the software widget displays the contextually relevantcontent within the same pixel profile (i.e., the same pixel space) ofthe originally published image 113. As such, the contextually relevantcontent can be displayed without affecting any of the other contentpublished on the digital content platform 112. Further, by providing thecontextually relevant content with a spatial relationship with respectto the image 113, the user 105 is more focused on the contextuallyrelevant content, without ruining the original aesthetic design providedby the publisher 110.

FIG. 2 is a high-level diagram illustrating another embodiment of thepresent invention. In FIG. 2, arrows A-F show the process flow of thesystem and method 200. The system and method 200 of FIG. 2 is describedwith relation to a digital content platform in the form of a web page.As would be understood by one of skill in the art, the system and method200 may also be employed in various equivalent digital contentplatforms, such as, browser-based web applications, softwareapplications, mobile device applications (e.g., phone or tabletapplications), TV widgets, and equivalents thereof.

In operation, a publisher 210 maintains an HTML web page script 212 on aserver 211 (Arrow A). The publisher 210 also inserts a reference scriptdirected to a dedicated content server 221 maintained by a serviceprovider 220 (Arrow B). A user 205 then employs an end-user device 206and web browser 208 to access the HTML web page script 212 via theInternet 207 (Arrow C). The user's web browser 208 then loads the HTMLweb page script as a viewable web page 212 within the web browser 208.The web page 212 may include content such as an image 213 and text 215.The image may include one or more hotspots 214, or other means ofactivating the image. In one embodiment, the image 213 is not originallypublished with a hotspot 214, but instead has a hotspot activated afterthe service provider 220 has identified and analyzed the image.

Arrow E indicates the reference script calling to the service provider220, and more specifically to the content decision engine 222, in orderfor the service provider to identify the image and identify content thatis contextually relevant to the image. Such contextually relevantcontent is then returned to the end-user device 206 for display withinthe web browser 208, as shown by Arrow F. Preferably, the contextuallyrelevant content is shown within the same pixel frame (or pixel profile)as the originally published image 213. In practice, the reference scriptmay be used to initiate a direct data link between the end-user device206 and the service provider 220. In one embodiment, such direct datalink is provided by creating a direct communication link (not shown)between the end-user device 206 and the content server 221. As such, theservice provider 220 can deliver executable code (or text instructionsthat can be compiled into executable code) directly to the end-userdevice 206. In one embodiment, the executable code (or instructions) isprocessed by the web browser 208 on the end-user device 206 to displaythe contextually relevant content in a spatial relationship with respectto the image 213. Such executable code (or instructions) may beconfigured to modify or otherwise animate the image in order tohighlight to the user 205 that the contextually relevant content isspecifically related to the image 213.

FIG. 3 is a high-level diagram illustrating yet another embodiment of asystem and method 300 for displaying contextually relevant content inassociation with an image published on a digital content platform. As inFIG. 2, the system and method 300 of FIG. 3 is described with relationto a digital content platform in the form of a web page. As would beunderstood by one of skill in the art, however, the system and method300 may also be employed in various equivalent digital contentplatforms, such as, browser-based web applications, softwareapplications, mobile device applications (e.g., phone or tabletapplications), TV widgets, and equivalents thereof.

As shown, a publisher 310 provides an HTML web page 312 from its server311, and includes a reference to an image on its image database 316, andan embed code received from the service provider 320. A user 305 thenemploys an end-user device 306 and web browser 308 to access the webpage script 312 on the publisher's server 311. The user's web browser308 then loads the web page 312. The web page 312 may include contentsuch as an image 313 and text 315. The image may include one or morehotspots 314, or other means of activating the image. In one embodiment,the image 313 is not originally published with a hotspot 314, butinstead has a hotspot activated after the service provider 320 hasidentified and analyzed the image.

The embed code functions to call on the service provider 320. The embedcode may also create a direct link between the end-user device 306 andthe service provider 320. As such, the service provider 320 can deliversoftware code (or corresponding computer-readable instructions) thatfunction to: 1) identify one or more images published on the web page,2) identify and/or set event handlers that watch for user activity;and/or 3) collect data on the image, text, user, publisher, and anyother valuable information for analyzing the image and identifyingcontextually relevant content that may be beneficial to the user. In oneembodiment, the software code (or corresponding computer-readableinstructions) may be pre-configured (by the service provider 320, thepublisher 310, and/or a third-party merchant) to only identify andanalyze images that meet certain pre-set criteria. For example, if thepublisher 310 wants to use his images for advertisement purposes, theservice provider 320 can identify images that meet marketablerequirements (set by either the publisher or a third-party merchant) inorder to identify contextually relevant advertisements to display in aspatial relationship with the image.

After identifying the published image, the service provider 320processes the image (or multiple images) through a content decisionengine 322, in order to identify content that is contextually relevantto the image(s). Such contextually relevant content is then returned tothe end-user device 306 for display within the web browser 308. Arrow330 also indicates that the service provider 320 provides executablecode (or computer-readable instructions that can be compiled intoexecutable code) to modify or otherwise animate (Arrow A of FIG. 3) theimage in order to highlight to the user 305 that the contextuallyrelevant content is specifically related to the image 313. For example,in one embodiment, the executable code (or computer-readableinstructions that can be compiled into executable code) employs CSSlanguage to perform a flip animation on the image 313, so as to show thecontextually relevant content on the apparent backside of the image.Preferably, the executable code (or computer-readable instructions thatcan be compiled into executable code) displays the contextually relevantcontent within the same pixel profile (i.e., the same pixel space, orsame screen location) of the originally published image 313. As such,the contextually relevant content can be displayed without affecting anyof the other content published on the web page 312.

To function as a means for identifying contextually relevant content forthe image 313, the content decision engine 322 may employ analysissystem components such as: algorithmic identification 323 or analysis ofthe image; image recognition protocols 324 and analysis of the image;proximate text recognition 325 in search of contextual information ofthe image based on text 315 published proximate to the image 313;submission of the image to a crowdsource network 326 to identify thecontext of the image and tag the image with relevant data; a thematictagging engine 327 to identify and tag the image with relevant data,based on a pre-defined theme; publisher provided information database328; and/or any combinations or equivalents thereof.

FIG. 4 is a flowchart describing one embodiment of the presentinvention. More specifically, FIG. 4 shows a method 400 for providingcontextually relevant content associated with an image published on adigital content platform. In step 401, a publisher is provided with areference script for publication with an image on a digital contentplatform. In practice, the reference script directs an end-user deviceto a service provider, which receives a request for content from theend-user's device in step 402. In step 403, the published image isidentified by, for example, one or more the means described above. Instep 404, contextually relevant content is identified by, for example,one or more of the means described above. In step 405, the contextuallyrelevant content is delivered to the end-user device. In step 406,executable instructions are also delivered to the end-user device. Theexecutable instructions are configured to cause the end-user's device todisplay the contextually relevant content in a spatial relationship withrespect to the image as originally published.

FIG. 5 is a flowchart describing another embodiment of the presentinvention. More specifically, FIG. 5 shows a method 500 for providingcontextually relevant content associated with an image published on adigital content platform, such as a web page. In step 501, a webpublisher is provided with a JavaScript embed HTML script for insertioninto a web page having at least one image. In step 502, based on theJavaScript embed HTML script, the method includes receiving a request toprovide JavaScript code to the user's web browser. In step 503,JavaScript code is provided to the user's web browser, wherein the webbrowser compiles the JavaScript code into JavaScript bytecode, which isexecuted on the user's browser. In one embodiment, the JavaScript codeis configured such that the compiled JavaScript bytecode is programmedto: 1) call for data (or content) relevant to an image on the web page;2) conduct an animation of the image on the web page; and/or 3) displaythe data (or content) in a spatial relationship with respect to theimage. In step 504, a content server (or more generally a serviceprovider) receives a request for data (or content) from the user's webbrowser, wherein said request is initiated by the JavaScript bytecode.In step 505, the content server (or service provider) provides the data(or content) to the user's web browser.

FIGS. 7A-7D show perspective views of an implementation of the presentinvention. More specifically, FIGS. 7A-7D show the present inventionfrom the perspective of an end-user. In practice, a user accesses awebsite, as shown in FIG. 7A. The website may include an image as wellas text (shown in dashed lines). In FIG. 7B, a user “mouses” over theimage to activate the image. As shown, a hotspot or tab is displayedindicating that by further activating the image (e.g., clicking theimage) additional information is available. In FIG. 7C, the user hasclicked onto the image. A request for content is then sent to theservice provider, as described above. The service provider then deliversexecutable instructions that causes the user's browser to animate theimage (e.g., by flipping the image). In FIG. 7D, a user is showncontextually relevant content on the apparent backside of the image.Such content is provided by the service provider in response to theuser's clicking of the image. Such content may include text related tothe image, applications to share or comment on the image, applicationsand/or links for purchasing products seen within the image, etc. Suchcontent is also shown in a spatial relationship with the image (e.g.,the content is provided within the same pixel frame, same pixel space,or same screen location as the originally published image).

Additional Embodiments

In one embodiment, there is provided a computer-implemented method fordisplaying contextually relevant content associated with an imagepublished on a digital content platform. The method comprises: (1)providing a publisher of the image with a reference script forpublication with the image, wherein the reference script is acomputer-readable instruction that causes an end-user device to call toa content server; and (2) configuring the content server to (a) receivea request for content from the end-user device, (b) identify thepublished image, (c) identify content that is contextually relevant tothe image, (d) deliver the content to the end-user device, and (e)deliver a computer-readable instruction that causes the end-user deviceto perform an animation that displays the content in a spatialrelationship with respect to the image as originally published. Thecontent may be identified by a crowdsourcing network, a thematic taggingengine, a computer-based algorithm, an image recognition engine, a textrecognition engine that identifies text published proximate to the imageon the digital content platform, based on publisher provided data,and/or any additional equivalent means. The computer-readableinstructions, which cause the end-user device to perform the animation,may incorporate CSS language, JavaScript language, HTML 5 Canvaslanguage, or any equivalent language. The spatial relationship may bedefined such that the content appears to be displayed on a backside ofthe image. The spatial relationship may also and/or alternatively bedefined such that the content is displayed within a pixel profile of theimage as originally published. For example, in one embodiment, thespatial relationship is defined such that the animation and/orcontextually relevant content completely covers the originally publishedimage. The content server may further be configured to: (3) delivercomputer-readable instructions that cause the end-user device toidentify whether the image meets one or more pre-defined requirementsbefore calling to the content server; (4) deliver computer-readableinstructions that require the end-user to activate the image beforecalling to the content server; and/or (5) deliver computer-readableinstructions that cause the end-user device to communicate data directlywith the content server.

In another embodiment, there is provided a computer-implemented methodfor displaying contextually relevant content associated with an imagepublished on a digital content platform. The method includes: (1)providing a publisher of the image with an embed code for publicationwith the image, wherein the embed code is a computer-readableinstruction that causes an end-user device to call to a dedicatedcontent server; and (2) configuring the dedicated content server to (a)receive a request for content from the end-user device, (b) identify thepublished image, (c) identify contextually relevant content for theimage, (d) deliver the contextually relevant content to the end-userdevice, and (e) deliver a computer-readable instruction that causes theend-user device to perform an animation that modifies the image andthereafter displays the contextually relevant content in a spatialrelationship with the image as originally published. The contextuallyrelevant content may be identified by a crowdsourcing network, athematic tagging engine, a computer-based algorithm, an imagerecognition engine, a text recognition engine that identifies textpublished proximate to the image on the digital content platform, basedon publisher provided data, and/or any additional equivalent means. Thecomputer-readable instructions, which cause the end-user device toperform the animation that modifies the image, may incorporate CSSlanguage, JavaScript language, HTML 5 Canvas language, or any equivalentlanguage. The spatial relationship may be defined such that thecontextually relevant content appears to be displayed on a backside ofthe image. The embed code may include computer-readable instructionsthat cause the end-user device to identify whether the image meets oneor more pre-defined requirements before calling to the dedicated contentserver. The embed code may include computer-readable instructions thatrequire the end-user to activate the image, with a user-actionableevent, before calling to the dedicated content server. The dedicatedserver may be further configured to deliver computer-readableinstructions that cause the end-user device to communicate data directlywith the dedicated server.

In another embodiment, there is provided a computer-implemented methodof displaying contextually relevant content (e.g., advertisements) onimages published on a digital content platform (e.g., images publishedwithin a mobile application on a mobile device). The method includesproviding the digital content platform (e.g., the mobile application onthe mobile device) with an interface for: (1) a user to activate theimage, and/or (2) the digital content platform to send images, imageidentifiers, image hashes, image unique reference locators (URLs), etc.,to a service provider computer system. The interface can be in the formof hotspots, icons, or other actionable buttons, as well as anapplication programming interface linked to the service providercomputer system. When the user activates the interface (e.g., bytouching a screen icon), the image (or image identifier, etc.) is sentto a service provider for processing. The service provider's computersystem receives a request for content from the user's device based onthe user's activation of the icon. The service provider's computersystem can then (a) identify the published image, (b) identify contentthat is contextually relevant to the image, (c) deliver the content tothe end-user device, and/or (d) deliver a computer-readable instructionthat causes the end-user device to perform an animation that displaysthe content in a spatial relationship with respect to the image asoriginally published. In this way, mobile applications (i.e., “apps”)that display (or scroll) multiple images across a limited screen space,can employ the teachings of this invention, to monetize the displayedimages, without compromising the aesthetics of the mobile application.In other words, the mobile application can be set up so as to continueto display multiple images without associated advertisements. If andwhen a user is interested in a particular image, the user can activatean icon requesting additional content. The service provider can processthe image through its content decision engine, and return relevantcontent (e.g., advertisements) back to the mobile application. Ananimation may then be employed to, for example, flip the image anddisplay the relevant content on the backside of the image. In anotherembodiment, the animation can overlay the content onto the image itself.Preferably, the content is displayed with the same pixel space (or atleast relatively close to the same pixel space) as the originallypublished image. As such, the relevant content can be displayed only ifand when a user is actually interested in seeing additional relevantcontent. The display of the additional relevant content can be donewithout ruining the aesthetics of the mobile application. The relevantcontent can include links to advertisers/merchants where the user canpurchase goods or services related to the contents/context of theoriginally displayed image.

Communication Between Parties Practicing the Present Invention

In one embodiment, communication between the various parties andcomponents of the present invention is accomplished over a networkconsisting of electronic devices connected either physically orwirelessly, wherein digital information is transmitted from one deviceto another. Such devices (e.g., end-user devices and/or servers) mayinclude, but are not limited to: a desktop computer, a laptop computer,a handheld device or PDA, a cellular telephone, a set top box, anInternet appliance, an Internet TV system, a mobile device or tablet, orsystems equivalent thereto. Exemplary networks include a Local AreaNetwork, a Wide Area Network, an organizational intranet, the Internet,or networks equivalent thereto. The functionality and system componentsof an exemplary computer and network are further explained inconjunction with FIG. 6, below.

Computer Implementation

In one embodiment, the invention is directed toward one or more computersystems capable of carrying out the functionality described herein. Forexample, FIG. 6 is a schematic drawing of a computer system 600 used toimplement the methods presented above. Computer system 600 includes oneor more processors, such as processor 604. The processor 604 isconnected to a communication infrastructure 606 (e.g., a communicationsbus, cross-over bar, or network). Computer system 600 can include adisplay interface 602 that forwards graphics, text, and other data fromthe communication infrastructure 606 (or from a frame buffer not shown)for display on a local or remote display unit 630.

Computer system 600 also includes a main memory 608, such as randomaccess memory (RAM), and may also include a secondary memory 610. Thesecondary memory 610 may include, for example, a hard disk drive 612and/or a removable storage drive 614, representing a floppy disk drive,a magnetic tape drive, an optical disk drive, flash memory device, etc.The removable storage drive 614 reads from and/or writes to a removablestorage unit 618. Removable storage unit 618 represents a floppy disk,magnetic tape, optical disk, flash memory device, etc., which is read byand written to by removable storage drive 614. As will be appreciated,the removable storage unit 618 includes a computer usable storage mediumhaving stored therein computer software, instructions, and/or data.

In alternative embodiments, secondary memory 610 may include othersimilar devices for allowing computer programs or other instructions tobe loaded into computer system 600. Such devices may include, forexample, a removable storage unit 622 and an interface 620. Examples ofsuch may include a program cartridge and cartridge interface (such asthat found in video game devices), a removable memory chip (such as anerasable programmable read only memory (EPROM), or programmable readonly memory (PROM)) and associated socket, and other removable storageunits 622 and interfaces 620, which allow computer software,instructions, and/or data to be transferred from the removable storageunit 622 to computer system 600.

Computer system 600 may also include a communications interface 624.Communications interface 624 allows computer software, instructions,and/or data to be transferred between computer system 600 and externaldevices. Examples of communications interface 624 may include a modem, anetwork interface (such as an Ethernet card), a communications port, aPersonal Computer Memory Card International Association (PCMCIA) slotand card, etc. Software and data transferred via communicationsinterface 624 are in the form of signals 628 which may be electronic,electromagnetic, optical or other signals capable of being received bycommunications interface 624. These signals 628 are provided tocommunications interface 624 via a communications path (e.g., channel)626. This channel 626 carries signals 628 and may be implemented usingwire or cable, fiber optics, a telephone line, a cellular link, a radiofrequency (RF) link, a wireless communication link, and othercommunications channels.

In this document, the terms “computer-readable storage medium,”“computer program medium,” and “computer usable medium” are used togenerally refer to media such as removable storage drive 614, removablestorage units 618, 622, data transmitted via communications interface624, and/or a hard disk installed in hard disk drive 612. These computerprogram products provide computer software, instructions, and/or data tocomputer system 600. These computer program products also serve totransform a general purpose computer into a special purpose computerprogrammed to perform particular functions, pursuant to instructionsfrom the computer program products/software. Embodiments of the presentinvention are directed to such computer program products.

Computer programs (also referred to as computer control logic) arestored in main memory 608 and/or secondary memory 610. Computer programsmay also be received via communications interface 624. Such computerprograms, when executed, enable the computer system 600 to perform thefeatures of the present invention, as discussed herein. In particular,the computer programs, when executed, enable the processor 604 toperform the features of the presented methods. Accordingly, suchcomputer programs represent controllers of the computer system 600.Where appropriate, the processor 604, associated components, andequivalent systems and sub-systems thus serve as “means for” performingselected operations and functions. Such “means for” performing selectedoperations and functions also serve to transform a general purposecomputer into a special purpose computer programmed to perform saidselected operations and functions.

In an embodiment where the invention is implemented using software, thesoftware may be stored in a computer program product and loaded intocomputer system 600 using removable storage drive 614, interface 620,hard drive 612, communications interface 624, or equivalents thereof.The control logic (software), when executed by the processor 604, causesthe processor 604 to perform the functions and methods described herein.

In another embodiment, the methods are implemented primarily in hardwareusing, for example, hardware components such as application specificintegrated circuits (ASICs). Implementation of the hardware statemachine so as to perform the functions and methods described herein willbe apparent to persons skilled in the relevant art(s). In yet anotherembodiment, the methods are implemented using a combination of bothhardware and software.

Embodiments of the invention, including any systems and methodsdescribed herein, may also be implemented as instructions stored on amachine-readable medium, which may be read and executed by one or moreprocessors. A machine-readable medium may include any mechanism forstoring or transmitting information in a form readable by a machine(e.g., a computing device). For example, a machine-readable medium mayinclude read only memory (ROM); random access memory (RAM); magneticdisk storage media; optical storage media; flash memory devices;electrical, optical, acoustical or other forms of propagated signals(e.g., carrier waves, infrared signals, digital signals, etc.), andothers. Further, firmware, software, routines, instructions may bedescribed herein as performing certain actions. However, it should beappreciated that such descriptions are merely for convenience and thatsuch actions in fact result from computing devices, processors,controllers, or other devices executing firmware, software, routines,instructions, etc.

For example, in one embodiment, there is provided a computer-readablestorage medium, stored on a content server, for displaying contextuallyrelevant content associated with an image published on a digital contentplatform. The computer-readable storage medium includes instructionsexecutable by at least one processing device that, when executed, causethe processing device to: (a) receive a request for content from anend-user device, wherein the end-user device is directed to the contentserver via a reference script published with the image on the digitalcontent platform; (b) identify contextually relevant content for theimage; (c) deliver the contextually relevant content to the end-userdevice; and (d) deliver a computer-readable instruction that causes theend-user device to perform an animation that modifies the image andthereafter displays the contextually relevant content in a spatialrelationship with the image as originally published. Thecomputer-readable storage medium may further comprise instructionsexecutable by at least one processing device that, when executed, causethe processing device to (e) provide the image to a crowdsourcingnetwork, and receive the contextually relevant content from thecrowdsourcing network; (f) provide the image to a thematic taggingengine, and receive the contextually relevant content from the thematictagging engine; (g) deliver the image to the thematic tagging engine,and receive at least one thematic tag from the thematic tagging engine;(h) identify contextually relevant content for the image based on thethematic tag; (i) identify whether the image meets one or morepre-defined requirements; and/or (j) require the end-user to activatethe image, with a user-actionable event, before calling to the dedicatedcontent server. The contextually relevant content for the image may beidentified based on text published proximate to the image on the digitalcontent platform. The computer-readable instruction, which causes theend-user device to perform the animation that modifies the image, mayincorporate CSS language, JavaScript language, HTML 5 Canvas language,or any equivalent language. The spatial relationship may be defined suchthat the contextually relevant content appears to be displayed on abackside of the image.

In another embodiment, there is provided a computer-readable storagemedium, stored on a dedicated content server, for displayingcontextually relevant content associated with an image published on adigital content platform, comprising instructions executable by at leastone processing device that, when executed, cause the processing deviceto: (a) receive a request for content from an end-user device, whereinthe end-user device is directed to the dedicated content server viaembed code published along with the image on the digital contentplatform; (b) identify the published image; (c) identify contextuallyrelevant content for the image, (d) deliver the contextually relevantcontent to the end-user device, and (e) deliver a computer-readableinstruction that causes the end-user device to perform an animation thatmodifies the image and thereafter displays the contextually relevantcontent in a spatial relationship with the image as originallypublished. The computer-readable storage medium may further compriseinstructions executable by at least one processing device that, whenexecuted, cause the processing device to: (f) deliver the image to thecrowdsourcing network, and receive contextually relevant content fromthe crowdsourcing network; (g) deliver the image to the thematic taggingengine, and receive at least one thematic tag from the thematic taggingengine; (h) identify contextually relevant content for the image basedon the thematic tag; (i) identify whether the image meets one or morepre-defined requirements; and/or (j) deliver a computer-readableinstruction that causes the end-user device to require the end-user toactivate the image, with a user-actionable event, before calling to thededicated content server. The contextually relevant content for theimage may be identified with a crowdsourcing network; a thematic taggingengine; and/or based on text published proximate to the image on thedigital content platform. The computer-readable instruction, whichcauses the end-user device to perform the animation that modifies theimage, may incorporate CSS language, JavaScript language, HTML 5 Canvaslanguage, or any equivalent language. The spatial relationship may bedefined such that the contextually relevant content appears to bedisplayed on a backside of the image.

Conclusion

The foregoing description of the invention has been presented forpurposes of illustration and description. It is not intended to beexhaustive or to limit the invention to the precise form disclosed.Other modifications and variations may be possible in light of the aboveteachings. The embodiments were chosen and described in order to bestexplain the principles of the invention and its practical application,and to thereby enable others skilled in the art to best utilize theinvention in various embodiments and various modifications as are suitedto the particular use contemplated. It is intended that the appendedclaims be construed to include other alternative embodiments of theinvention; including equivalent structures, components, methods, andmeans.

As will be apparent to those of skill in the art upon reading thisdisclosure, each of the individual embodiments described and illustratedherein has discrete components and features which may be readilyseparated from or combined with the features of any of the other severalembodiments without departing from the scope or spirit of the presentinvention. Any recited method can be carried out in the order of eventsrecited or in any other order which is logically possible. Further, eachsystem component and/or method step presented should be considered a“means for” or “step for” performing the function described for saidsystem component and/or method step. As such, any claim languagedirected to a “means for” or “step for” performing a recited functionrefers to the system component and/or method step in the specificationthat performs the recited function, as well as equivalents thereof.

It is to be appreciated that the Detailed Description section, and notthe Summary and Abstract sections, is intended to be used to interpretthe claims. The Summary and Abstract sections may set forth one or more,but not all exemplary embodiments of the present invention ascontemplated by the inventor(s), and thus, are not intended to limit thepresent invention and the appended claims in any way.

1. A non-transient computer-readable storage medium for displayingadditional content associated with images published on a digital contentplatform, comprising: instructions executable by at least one processingdevice that, when executed, cause the processing device to (a) publishone or more images on the digital content platform, (b) provide aninterface that allows an end-user to activate a published image, (c)request additional content for the activated image from a contentserver, (d) submit image data for the activated image to a contentdecision engine of the content server, wherein the image data isselected from the group consisting of: the activated image, an imageidentifier, an image hash, an image unique reference locator (URL), animage tag, and combinations thereof, wherein the content server uses theimage data to identify additional content for association with theactivated image, wherein the additional content is selected from thegroup consisting of: an advertisement, text, data, an image, a video,one or more controls, applications, computer-readable instructions,interactive functions, informational functions, third-party in-imageapplications, and combinations thereof, and (e) receive the additionalcontent from the content server, and (f) perform an animation thatmodifies the activated image, based on the additional content receivedfrom the content server, so as to display the additional content toappear on a backside of the activated image, to overlay the activatedimage, or to completely cover the activated image, wherein theadditional content includes content contextually relevant to theactivated image and wherein the additional content is identified by thecontent decision engine based on input selected from the groupconsisting of: algorithmic identification or analysis of the image,image recognition protocols, proximate text recognition algorithms thatsearch for contextual information of the image based on text publishedproximate to the image, a submission of the image to a crowdsourcenetwork to identify the context of the image and tag the image withrelevant data, a thematic tagging engine to identify and tag the imagewith relevant data based on a pre-defined theme, and publisher provideddata on the image.
 2. The computer-readable storage medium of claim 1,wherein the digital content platform is a mobile device application. 3.The computer-readable storage medium of claim 1, wherein the digitalcontent platform is selected from the group consisting of: a web page, awebsite, a browser-based web application, software application, and a TVwidget. 4.-5. (canceled)
 6. A non-transient computer-readable storagemedium for displaying contextually relevant content associated withimages published in a mobile application, comprising: instructionsexecutable by at least one processing device that, when executed, causethe processing device to (a) publish one or more images in the mobileapplication, (b) provide a user interface that allows an end-user torequest additional content for at least one of the published images byactivating the image with the user interface, (c) submit image data forthe activated image to a content decision engine of a content server,wherein the image data is selected from the group consisting of: thepublished image, an image identifier, an image hash, an image uniquereference locator (URL), and an image tag, and wherein the contentdecision engine uses the image data to identify additional content forassociation with the image, (d) receive the additional content for theactivated image from the content decision engine, and (e) perform ananimation that modifies the activated image to display the additionalcontent so as to appear on a backside of the activated image, to overlaythe activated image with the additional content, or to completely coverthe activated image with the additional content, wherein the additionalcontent includes content contextually relevant to the activated imageand wherein the additional content is identified by the content decisionengine based on input selected from the group consisting of: algorithmicidentification or analysis of the image, image recognition protocols,proximate text recognition algorithms that search for contextualinformation of the image based on text published proximate to the image,a submission of the image to a crowdsource network to identify thecontext of the image and tag the image with relevant data, a thematictagging engine to identify and tag the image with relevant data based ona pre-defined theme, and publisher provided data on the image.
 7. Thecomputer-readable storage medium of claim 6, wherein the additionalcontent is an advertisement. 8.-9. (canceled)
 10. A non-transientcomputer-readable storage medium for displaying content related toimages published on a digital content platform, comprising: instructionsexecutable by at least one processing device that, when executed, causethe processing device to (a) publish one or more images on the digitalcontent platform, (b) provide a user interface that allows an end-userto activate a published image, (c) identify content related to theactivated image, and (d) perform an animation that modifies theactivated image to display the related content so as to appear on abackside of the activated image, to overlay the activated image with therelated content, or to completely cover the activated image with therelated content, wherein the related content includes contentcontextually relevant to the activated image and wherein the additionalcontent is identified by a content decision receiving input selectedfrom the group consisting of: algorithmic identification or analysis ofthe image, image recognition protocols, proximate text recognitionalgorithms that search for contextual information of the image based ontext published proximate to the image, a submission of the image to acrowdsource network to identify the context of the image and tag theimage with relevant data, a thematic tagging engine to identify and tagthe image with relevant data based on a pre-defined theme, and publisherprovided data on the image.
 11. The computer-implemented method of claim10, wherein the related content is identified by receiving the relatedcontent from a service provider's content server.
 12. (canceled)
 13. Thecomputer-readable storage medium of claim 10, wherein the digitalcontent platform is a mobile device application.
 14. Thecomputer-readable storage medium of claim 10, wherein the digitalcontent platform is selected from the group consisting of: a web page, awebsite, a browser-based web application, software application, and a TVwidget.
 15. The computer-readable storage medium of claim 10, whereinthe related content is an advertisement.
 16. (canceled)
 17. Thecomputer-readable storage medium of claim 10, wherein the additionalcontent is selected from the group consisting of: an advertisement,text, data, an image, a video, one or more controls, applications,computer-readable instructions, interactive functions, informationalfunctions, third-party in-image applications, and combinations thereof.18. A computer-implemented method for displaying contextually relevantcontent associated with an image published on a digital contentplatform, comprising: providing a publisher of the image with areference script for publication with the image, wherein the referencescript is a computer-readable instruction that causes an end-user deviceto provide an interface that allows an end-user to activate the imageand thereby perform a request for content call to a content server; andconfiguring the content server to (a) receive the request for contentcall from the end-user device, (b) identify the activated image, (c)identify whether the activated image meets one or more pre-definedrequirements, (d) identify content that is contextually relevant to theactivated image, (e) deliver the content to the end-user device, and (f)deliver a computer-readable instruction that causes the end-user deviceto display the content so as to appear on a backside of the activatedimage, to overlay the activated image with the content, or to completelycover the activated image with the content, wherein the content isidentified by receiving input selected from the group consisting of:algorithmic identification or analysis of the image, image recognitionprotocols, proximate text recognition algorithms that search forcontextual information of the image based on text published proximate tothe image, submission of the image to a crowdsource network to identifythe context of the image and tag the image with relevant data, athematic tagging engine to identify and tag the image with relevant databased on a pre-defined theme, and publisher provided data on the image.19. The computer-implemented method of claim 18, wherein the content isidentified with a crowdsourcing network.
 20. (canceled)
 21. Thecomputer-implemented method of claim 18, wherein the digital contentplatform is a mobile device application.
 22. The computer-implementedmethod of claim 18, wherein the digital content platform is selectedfrom the group consisting of: a web page, a website, a browser-based webapplication, software application, and a TV widget.
 23. Thecomputer-implemented method of claim 18, wherein the contextuallyrelevant content is an advertisement.
 24. (canceled)
 25. Thecomputer-implemented method of claim 18, wherein the contextuallyrelevant content is selected from the group consisting of: anadvertisement, text, data, an image, a video, one or more controls,applications, computer-readable instructions, interactive functions,informational functions, third-party in-image applications, andcombinations thereof.